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SUMhURY AND  CONCLUSIONS  1.  INTRODUCTION 

Several  research  groups  across  the  country  arc  Several  concepts  of  modular  robotic  s>’stems  have  been 


interested  in  the  development  of  modular  robotics  systems. 
One  issue  pertaining  to  modular  robotic  systems  is  the 
integration  of  modules  into  a  fully  functional  robot  system. 
Two  criteria  for  modules  integration  not  previously 
investigated  are  the  reliability  and  accuracy  of  the  system. 
This  paper  presents  the  results  of  the  development  of  a 
framework  for  a  "criterion"  embodying  these  two  modular 
robot  characteristics. 

Using  a  probabilistic  representation  of  manipulator 
kinematics  and  a  reliability  block  diagram  model  of  the 
manipulator  system,  a  Reliability  Performance  Index  (RPI) 
representing  the  probability  of  no  hardware  or  software 
failure  and  the  manipulator  achieving  a  specified  position  and 
orientation  is  developed.  The  RPI  is  tested  with  a  case  study 
consisting  of  a  three  degree-of-freedom  planar  manipulator 
assembled  from  a  choice  of  six  joint  modules  of  varying 
reliability  and  precision  and  a  choice  of  six  link  module 
combinations  of  varying  lengths  and  machining  tolerances. 
A  straight-line,  square  trajectory  is  specified  and  the  RPI  is 
calculated  for  each  combination  of  joint  modules  and  links,  a 
total  of  1296  different  combinations.  An  Analysis  of 
Variance  (ANOVA)  is  performed  on  the  results  using  the 
different  joint  locations  and  link  options  as  factors  and  the 
different  joint  modules  and  link  options  as  factor  levels.  The 
different  factors  are  tested  for  significance  and  the  Tukey 
Studentized  Range  Test  is  performed  to  determine 
significance  of  the  different  joint  modules  and  link  options. 

Using  this  statistical  testing,  a  70%  reduction  in  the 
module  design  space  is  achieved  using  the  RPI.  Optimization 
using  other  appropriate  manipulator  criteria  can  then  be 
performed  to  generate  the  final  configuration.  Additional 
extensive  case  studies  are  needed  to  fully  develop  the  RPI  to  a 
stage  necessary  for  implementation  into  a  computer-aided 
design  system  for  modular  robot  configuration  design.  The 
RPI  may  also  be  useful  in  the  quantification  of  the  overall 
system  reliability  and  performance  of  any  system  based  upon 
measured  error,  such  as  conuol  systems. 
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presented  and  developed  over  the  past  several  years.  For 
practical  operation,  the  system  will  need  to  be  configured  for 
a  particular  application  or  task  from  a  suite  of  available 
modules.  This  integration  requires  the  use  of  different 
criteria  on  which  to  base  the  module  selection.  One  of  these 
criteria  is  the  accuracy  of  the  robotic  system.  Another 
criterion  is  the  reliability  of  the  system.  In  several 
applications,  both  of  these  criteria  are  the  over-riding 
characteristics,  including  microelectronics  assembly  [11], 
space  applications  [3]  and  nuclear  reactor  maintenance  [lOj. 
■niis  paper  presents  a  framework  for  the  formulation  of  a 
reliability  index,  quantifying  the  statistical  characteristics  of 
modular  robot  system  reliability  and  accuracy. 

Nomenclature  and  Notation.  The  notation  used  in  this  paper 
follows  standard  statistical  practice  with  the  meanings  of 
various  terms  defined  as  they  are  used. 

2.  REUABIUTY  PERFORMANCE  INDEX  FORMULA  TION 

For  a  robotic  system,  failure  can  be  defined  as  the 
manipulator  not  reaching  a  commanded  position  and 
orientation  (denoted  together  as  the  "pose"  of  the  robot) 
within  a  certain  error  bound.  There  are  two  basic  causes  for 
this  failure,  variation  in  the  kinematic  parameters  of  the 
robotic  ^’Stern,  and/or  a  failure  in  the  hardware  or  software  of 
the  system  causing  the  robot  not  to  achieve  the  commanded 
pose.  If  we  can  assume  that  these  two  causes  of  failure  are  s- 
independent  (which  can  be  justified  except  in  those  cases  of  a 
fault-tolerant  manipulator  where  a  hardware  failure  does  not 
cause  a  failure  of  the  system  to  achieve  a  pose),  we  can  form  a 
Reliability  Performance  Index  (RPI)  using  a  serial 
combination  of  the  hardware,  software,  and  kinematic 
reliability  functions  of  the  manipulator.  In  its  most  general 
formulation  the  RPI  can  be  expressed  as 


JiP/(0  =  J^,(0K(0Ji,(0  (1) 
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where  R),(t)  =  the  system  hardware  reliability  fimction 
Rj(t)  =  the  system  software  reliability  ftmeuor. 
Rig(t)  =  the  system  kinematic  reliability  ftmction 
If  the  j-independence  assumption  is  satisfied,  the  RPI  is 
the  probability  that  the  manipulator  will  move  to  the 
commanded  pose.  The  time  dependence  of  Equation  (1) 
allows  for  the  future  development  of  a  dynamic  enterion  but 
due  to  the  current  limitations  in  robot  system  metrology  ,  we 
cannot  as  yet  quantify’  a  time  based  degradation  in  the 
kinematic  reliability  function  as  it  is  developed  in  the  next 
section.  For  this  reason,  a  simpler,  static  formulation  of  the 
RPI  is  made  as 


RP1  =  R,R,R,  (2) 


The  derivation  of  the  kinematic  reliability  model  follows. 


3.  KINEMATIC RELIAEIUTY 


The  static  kinematic  reliability  represents  the 
probability  of  the  pose  of  the  manipulator  end-effector  being 
within  a  certain  error  bound  due  to  kinematic  variations. 
This  concept  was  first  proposed  by  Bhatti  and  Rao  [2].  The 
kinematic  reliability  is  a  direct  indicator  of  the  accuracy  of 
the  manipulator  and  is  based  upon  the  sources  of  error  in  the 
manipulator  kinematics.  These  errors  can  be  caused  by 
compliances,  machining  tolerances,  position  measurements 
etc.  and  can  be  represented  as  variations  in  the  kinematic 
variables  of  a  robotic  system.  As  a  first  step,  these  kinematic 
variables  are  assumed  to  be  s-normally  distributed. 

The  kinematics  of  a  manipulator  can  be  expressed 
via  the  Denavil-Hartenberg  (D-H)  formulation  [5].  In  the  D- 
H  notation,  two  parameters  are  associated  with  each  link  (o^ 
and  a,)  and  two  with  each  joint  (of,  and  9,).  The  distance  d, 
and  the  angle  6,  between  adjacent  links  give  the  relative 
position  between  the  links  and  the  length  a,  and  twist  angle 
a,  determine  the  structure  of  the  link.  For  revolute  joints,  d,, 
O;,  and  a,  are  the  structural  parameters  and  0,  is  the  joint 
variable.  For  prismatic  joints,  0,  is  a  structural  parameter  and 
d,  is  the  joint  variable. 

The  direct  kinematic  problem  is  to  solve  for  the 
position  and  orientation  of  the  end-effector  given  the  arm 
structural  parameters  and  the  values  of  the  joint  variables. 
Coordinate  frames  are  attached  to  each  link  and 
transformation  matrices  from  link  frame  to  link  frame  are 
written  in  terms  of  the  relevant  kinematic  and  joint 
parameters.  This  transformation  relating  link  frame  i  to  link 
frame  i-l  (known  as  the  D-H  transformation  matrix)  can  be 
shown  to  be 
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where  C  denotes  cosine  and  S  denotes  sine  |4]  Using  this 
notation,  the  end -effector  position  md  orientation  can  be 
calculated  as 

1=1 

where  n  denotes  the  number  of  joints  in  the  manipulator 
system.  [7]  is  called  the  arm  matrix  The  end-effector 
position  is  found  from  the  right-most  column  vector  of  the 
arm  matrix  The  upper-left  3  by  3  partition  is  the  rotation 
matrix  from  the  base  frame  to  the  end-effector  frame. 

We  can  now  define  the  kinematic  reliability  of  the 
manipulator  to  be  the  probability  of  the  end-effector  being  in 
a  certain  pose  within  a  specified  error  bound  due  to  errors  in 
the  kinematic  variables.  This  implies  the  definition  of  a 
permissive  region  about  the  desired  end-effector  position 
Using  Bhatti  and  Rao's  notation,  we  choose  to  use  the  Type 
III  permissive  region  which  is  a  box  or  sphere  shaped  region 
about  the  desired  position.  The  box  shaped  positional 
kinematic  reliability'  of  the  manipulator  can  be  described  as 

Ran  =  -  Ax  <  X*  <  -f-  Ax)^ 

(jj  -  Ay  <y*  <yj+  Ay)<u  (5) 

(Zj-Az<Z*<2j+A2)} 

where  (xj,  zj)  is  the  desired  end-effector  position  and  (Ax, 

Av,  Ax)  is  the  specified  tolerance  on  the  position.  A  similar 
definition  can  be  made  lOr  the  spherical  permissive  region. 

Two  methods  can  be  used  to  determine  the  kinematic 
reliability  for  a  manipulator.  The  analytical  method  uses  the 
algebra  of  random  variables  to  determine  the  end-effector 
position  and  orientation  s-probability  distribution  function 
and  then  integrates  over  the  permissive  region  to  determine 
the  kinematic  reliability.  This  approach  is  mathematically 
intractable  since  a  general  manipulator  will  require  a  s- 
hexavariate  disiribuii-'n  to  describe  the  pose  of  the 
manipulator. 

An  alternative  to  this  approach  is  to  use  Monte  Carlo 
simulation  to  determine  the  kinematic  reliability.  A  s- 
probability  distribution  of  each  kinematic  variable  is 
determined  or  assumed  and  a  sample  is  taken  from  each  of 
these  distributions  is  taken.  These  samples  are  then 
substituted  into  Equation  (4)  and  the  end-effector  position 
and  orientation  for  those  samples  are  determined.  This  pose 
is  a  sample  from  the  end-effector  position  and  orientation  s~ 
distribution  [12].  This  sample  can  be  compared  to  the 
permissive  region  and  if  it  is  inside,  the  trial  is  considered  a  ' 
success.  The  kinematic  reliability  is  then  the  ratio  of  the 
number  of  successes  to  the  total  number  of  trials  as  expressed 
in  Equation  (6). 


number  of  sucessful  trials 
total  number  of  trials 


(6) 


One  problem  encountered  at  this  point  is  the  fact  that 
the  accuracy  and  repeatability,  and  thus  the  kinematic 
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reliability,  varies  over  the  workspace  113]  If  we  are  to  use 
the  formulatiun  of  Equation  (2).  we  need  to  ha\e  a  single 
value  of  over  the  workspace  or  trajectory  Based  on 
computational  issues,  we  chose  to  use  the  minimum  value  of 
the  kinematic  reliability  over  the  workspace  or  specified 
trajccioty.  This  also  provides  the  most  consenative  index 
value 


3 .  HARDWARE  Ah’D  SOFTWARE  REUABIUTY 

The  other  component  of  the  RPl  needed  for  Equation  (2) 
is  a  quantification  of  the  hardware  and  software  reliability. 
The  different  types  of  hardware  reliability  models  considered 
where  reliability  block  diagrams  (7j.  Markov  models  (151, 
and  Fault  Tree  models  [61,  The  software  models  considered 
were  two  modular  models,  the  Littlewood  model  [9|  and  the 
Kubat  model  [8].  The  criteria  used  to  select  the  models  were 
modularity  of  the  model,  modularity  of  the  data  required  for 
the  model,  computational  complexity,  and  the  ability  to 
include  fault  tolerance  in  the  mode!  at  a  later  date. 

Based  on  rankings  for  each  model  in  each  category  ,  the 
reliability  block  diagram  model  was  selected  for  the  hardware 
reliability  model  and  the  Littlewood  modular  software 
reliability  model  was  chosen.  For  most  robotic  systems,  the 
hardware  reliability  structure  is  serial  since  the  failure  of  one 
component  will  cause  the  failure  of  the  system.  The 
hardware  component  of  the  RPI  can  be  expressed  as 

^.(')=n^(')  (1) 

1=1 

where  n  is  the  number  of  modules  and  /?,(/)  is  the  reliability 
function  for  the  /th  module. 

The  Littlewood  modular  software  model  is  an  s- 
exponential  failure  model  and  the  s-failure  rate  can  be 
represented  as 


•  V 


To  demonstrate  the  utility  of  the  RPl  and  how  it  is 
calculated,  a  limited  case  study  is  presenied  ne.xt 

4.  RPI  EXAMPLE 
4.1.  The  Manipulator 

The  objective  of  this  example  is  to  use  the  RPl  to  help 
select  the  modules  from  a  suite  of  available  modules  The 
desired  sy  stem  is  a  3  Degree-Of-Freedom  (DOF)  manipulator 
shown  in  Figure  1  This  manipulator  is  e.xpectcd  to  perform 
the  trajectory  illustrated  in  Figure  2  The  position  tolerance 
is  ±0.001  meter  in  both  x  and  y  directions  and  0.1°  on  the 
orientation  of  the  end-effector.  The  available  components  are 
listed  in  Tables  1  and  2.  The  links  are  assumed  to  have  a 
zero  failure  rate  and  the  joint  modules  are  assumed  to  have  a 
constant  failure  rate  that  is  proportional  to  the  precision 
(inversely  proportional  to  the  standard  deviation  of  the  joint 
module  position).  Each  link  combination  represents  a 
different  inverse  kinematic  solution.  The  inverse  kinematics 
for  each  link  option  was  derived  after  Craig  (4J  and  the 
required  joint  angles  to  achieve  each  position  annotated  in 
Figure  2  where  calculated  The  kinematics  of  the  system  of 
Figure  1  arc 


X  =  /,  COS  +  /j  COS(^,  +62) 

y-l^  sin  +  /j  sin(^,  +  )  (10) 

^  =  0-^  +  O2  F  Oy 


where  x  and  y  represent  the  end-effector  position  and  <J> 
represents  the  end-effector  orientation.  Using  a  rectangular 
permissive  region  and  an  angular  tolerance  on  the  end- 
effector  orientation,  we  can  represent  the  kinematic  reliability 
of  the  system  as 


R^{.x,y,<t>)  =  P 


-O.OOli  X  i  Xj  +  Q.00l)<~J 
(V,,  -  0. 00 1  S  y  i  y,,  +  0. 00 1) 
(D^-O.ISOSO^+O.I) 


(11) 


where  o,  =  the  proportion  of  time  spent  in  module  /, 
bjj  =  the  frequency  of  transfer  of  control  from 
module  i  to  module  7, 

Vj  =  software  module  i  failure  rate,  and 
Xy  =  the  probability  of  failure  during  control 
transfer  from  i  to  j. 

The  hardware  and  software  models  are  time-dependent, 
so  we  must  choose  a  time  of  evaluation  to  obtain  a  static  value 
to  use  in  Equation  (2).  Since  the  RPI  is  meant  to  be  a 
comparative  tool,  a  single  time  of  evaluation  for  all  the 
modules  will  provide  a  relative  number  on  which  to  base  the 
comparisons.  We  chose  to  ex'aluated  the  time  as 

(9) 

where  is  the  minimum  e.xpected  life  of  any  hardware  or 
software  module  in  the  system. 


and 

=  min  (x,y,  O)  (12) 

The  hardware  reliability  of  the  system  is  assumed 

exponential  and  can  be  expressed  as 

=  (13) 

where 

~  ^Base  ^'’Elbow  "*■  ^IVrisi  (^^) 

since  the  links  do  not  contribute  to  the  system  failure  rate. 
Equation  (14)  does  not  include  the  controller  or  softw^ie  tfio: 
would  be  necessan'  to  control  this  svstem  which  makes  R,  =  1 
in  Equation  (2),  although  these  components  can  be  easily 
added  if  data  is  available.  Examining  Table  2.  it  is  seen  that 
the  minimum  Mean-Time-Between-Failure  (MTBF) 
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(  =  inverse  of  the  failure  rate)  for  the  joint  modules  is  1852 
hours  (module  6)  The  time  chosen  for  hardware  reliabilm 
evaluation  is  100  hours,  uhich  satisfies  the  suggested 
criterion  of  Equation  (9) 

A  Monte  Carlo  simulation  is  performed  to  evaluate  the 
kinematic  reiiabiliK  of  the  system  at  each  position  of  the 
trajectory  of  Figure  2  for  each  link  option  and  joint  module 
combination.  Five  hundred  trials  at  each  end-effector 
position  are  generated  and  the  kinematic  reliability  at  that 
position  is  calculated  with  Equation  (6).  The  minimum 
kinematic  reliability  over  the  workspace  is  used  to  represent 
the  system  kinematic  reliability  per  Equation  (13).  Each 
simulation  was  repeated  five  times  and  the  results  where 
averaged  to  obtain  the  system  kinematic  reliability  for  the 
particular  link  and  actuator  combination.  The  hardware 
reliability  was  evaluated  per  Equation  (13)  for  each 
combination  of  joint  modules  and  the  RPI  was  calculated  per 
Equation  (2). 


y 


Figure  1.  Three  Degree  of  Freedom  Manipulator 


y 


Figure  2.  Rectangular  Motion  Path  for  the  3-DOF 
Manipulator  (Arrow  Indicates  End-Effector  Orientation) 


Tabic  1.  Link  Module  Characteristics 


Option 

Ij  (m) 

/,(m) 

X/10*  hr 

a  (m) 

1 

0.75 

0.75 

0.0 

0.0001 

2 

1.0 

0.5 

0.0 

0  0001 

3 

0.5 

1.0 

0.0 

0.0001 

4 

0.75 

0.75 

0.0 

0.001 

5 

1.0 

0.5 

0.0 

0.001 

6 

0.5 

1.0 

0.0 

0.001 

Table  2.  Actuator  Module  ChardCteristics 


Joint  Module  # 

(/lO^  hours) 

- 1 

c  (degrees) 

1 

40 

0.1 

2 

140 

0.05 

3 

240 

0.01 

4 

340 

0.005 

5 

440 

0.001 

6 

540 

0.0005 

4.2  Optimization  and  Design  Selection 

Figure  3  shows  a  history'  of  how  the  RPI  changes  as  the 
joint  modules  are  changed  for  link  option  1.  The  horizontal 
axis  is  the  joint  module  combinat'on.  Joint  module 
combination  1  corresponds  to  the  joint  module  one  in  each 
joint  location  (Base,  Elbow,  Wrist)  =  (1,  1,  1)  and 
combination  216  corresponds  to  joint  module  6  in  each 
location  (6,  6,  6).  The  simulations  iterated  from  the  wrist 
inward,  making  joint  modular  combination  2  represent  the 
joint  module  locations  (1,  1,2).  This  history  was  repeated  for 
each  of  the  six  link  module  combinations  tested  in  Table  1. 
Figure  3  is  representative  of  the  higher  tolerance  (smaller 
variance)  links.  Figure  4  shows  the  same  behavior  but  with 
lower  RPI  values  for  the  lower  tolerance  (higher  variance) 
links. 

The  first  question  to  be  examined  is  "does  the  maximum 
RPI  value  correspond  to  a  maximum  in  the  design  space  and 
does  this  represent  an  optimum  point  in  the  design  <^ace?" 
We  first  must  describe  what  we  mean  by  "optimum."  In  the 
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context  of  the  RPl.  we  are  searching  for  the  combination  of 
actuators  that  will  maximize  both  s>stem  reliabilm  and 
accuracy  (as  represented  by  the  kinematic  reliability) 
Usually,  the  optimization  objective  function  is  a  function  of 
the  design  variables  How'exer.  in  the  case  of  the  RPl,  the 
design  variables  are  not  explicit  and  we  must  address  what 
the  maximum  actually  means 

The  RPl  basic  formulation  is  found  in  Equation  (2).  All 
components,  the  hardware  reliability  and  the  kinematic 
reliability  ,  are  measures  of  probability  and  are  bounded  to  be 
non-negative  and  less  than  or  equal  to  unity,  thus  the 
maximum  value  of  the  RPl  is  unity  representing  a  certainty  of 
no  failures  as  well  as  always  being  inside  the  permissible  pose 
region.  The  highest  value  of  kinematic  reliability  means  that 
the  particular  combination  is  the  most  accurate,  having  the 
highest  probability  of  being  inside  the  error  bound  on  the 
pose.  The  highest  value  of  hardware  reliability  means  that 
the  particular  combination  of  components  is  the  most  reliable 
of  all  the  combinations.  One  might  decide  to  pick  the  most 
accurate  combination  that  has  a  reliability  of  at  least,  say. 
0.98  at  100  hours  or  the  objective  may  be  reversed:  the 
highest  reliability  with  at  least  a  0.9  kinematic  reliability. 

Table  3  presents  the  results  of  the  simulations  of  the 
trajectory  of  Figure  2.  A  large  difference  can  be  seen  betw  een 
the  maximum  and  minimum  values  for  the  different  link  and 
joint  module  combinations.  The  most  immediate  difference 
can  be  seen  between  the  two  sets  of  tolerances  of  the  link 
modules.  The  higher  tolerance  links  make  a  tremendous 
difference  in  the  value  of  the  achieved  RPl.  Based  upon  the 
maximum  value  of  the  RPl  of  unity,  one  would  select  link 
option  2  w'ith  joint  module  #3  in  every  joint  position.  This  is 
the  deterministic  approach.  However,  the  maximum  RPl 
values  are  extremely  close  together,  within  one  standard 
deviation  of  the  mean  RPl.  The  statistical  significance  of  this 
fact  is  discussed  next. 

Additional  deterministic  numerical  optimizations  where 
performed  on  the  hardware  and  kinematic  reliabilities  using 
the  other  component  of  the  RPl  as  a  constraint. 
Conceptually,  these  optimizations  can  be  performed 
analytically  if  the  hardware  and  kinematic  reliabilities  can  be 
expressed  analytically.  However,  since  the  case  study 
example  is  empirical,  only  empirical  optimizations  were 
made.  One  aspect  of  this  particular  exercise  must  be  noted: 
Rj^  is  a  stochastic  variable  xvith  a  standard  deviation.  In 
general,  the  failure  rates  of  Tables  1  and  2  will  be  estimates 
based  on  test  data  having  their  own  means  and  variances.  In 
this  particular  case,  Rf^  is  considered  a  constant  (since  it  was 
evaluated  from  an  assumed  know'n  distribution)  and  the  only 
variability  in  the  value  of  the  RPl  comes  from  the  kinematic 
reliability  although  this  would  not  be  true  in  a  general  case. 
This  variability  prevents  a  deterministic  optimization  from 
providing  an  accurate  answer,  since  the  variation  can  cause 
the  optimum  to  vary  widely  over  the  design  space.  However, 
performing  a  deterministic  optimization  using  the  values  of 
R)^  at  this  stage  is  useful  to  observe  the  general  tendencies  of 
behavior  of  the  RPl  when  compared  to  its  components. 


Joini  Module  Cocnbiraoon  Number 


Figure  3.  RPl  b>  Joint  Module  Combinations  Link  Option 
1.  /|  =  0.75  m.  Tolerance  =  0.000 1  m 


OpQund 


Joint  Module  Combinetion  Number 

Figure  4.  RPl  by  Joint  Module  Combinations:  Link  Option 
4,  /[  =  ^2  ~  ®  Tolerance  =  0.001  m 

All  of  these  optimizations  provided  maximums  and 
minimums  very  close  to  the  same  maximum  and  minimum 
points  (expressed  as  joint  combinations)  as  the  numerical 
results  of  Table  3,  with  the  difference  in  the  values  results 
from  the  variation  in  the  kinematic  reliability  .  This  limited 
data  example  indicates  that  tlie  RPl  has  a  tendency  to  the 
same  maximum  that  a  deterministic  optimization  on  both  RPl 
components  will  find.  While  not  a  one-to-one  correlation  on 
maximum  points,  the  optimum  configurations  are  very  close 
in  their  characteristics,  indicating  "adjacent"  points.  This 
indicates  confidence  can  be  placed  in  the  RPl  to  identify  a 
configuration  that  posses  a  satisfactory  trade-off  between 
precision  and  system  reliability. 

If  we  examine  the  plots  of  the  RPl  vs.  the  joint  module 
combinations  in  Figures  3  and  4,  we  see  a  definite  difference 
between  the  different  joint  modules  and  the  locations  they  are 
in.  The  most  obvious  aspect  is  having  joint  module  1 
(highest  hardware  reliability  and  lowest  tolerance)  and  joint 
module  2  have  much  low'er  values  of  the  RPl  no  matter  what 
modules  are  in  the  distal  locations.  The  deep  dips  are  also 
due  to  the  use  of  joint  modules  1  and  2  in  the  distal  locations. 
The  standard  deviations  of  the  joint  modules  also  have  a 
significant  impact.  Figures  3  and  4  give  a  clear  indication  of 
when  the  kinematic  reliability  component  of  the  RPl 
dominates  the  hardware  reliability.  For  standard  deviations 
of  the  joint  modules  greater  than  or  equal  to  ag  =  0.05,  the 
RPl  is  dominated  by  the  lack  of  accuracy'  in  the  modules. 
When  the  standard  deviations  are  less  than  0.05,  the  system  is 
accurate  enough  and  the  hardware  reliability  becomes 
important. 
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Table  3.  Maximum  and  Minimum  Results  from  RPI 
Simulation  of  Figure  2 


Link 

Opt 

B 

E 

W' 

Min/ 

Max 

Rh 

Rk 

RPI 

1 

T" 

"3" 

Max 

0. 93044 

0.99987 

0.93034 

1 

1 

1 

Min 

0.98799 

0.1664 

0.1644 

2 

3 

3 

3 

Max 

0.93044 

1.0 

0.9.3044 

1 

1 

1 

Min 

0.98797 

0.17599 

0.17388 

3 

3 

3 

3 

Max 

0.93044 

0  9996 

0  93011 

n 

n 

n 

Min 

0.1681 

II 

a 

D 

D 

Max 

0.9212 

0.44907 

0  41368 

n 

n 

D 

Min 

0.98802 

0,082 

0.08102 

5 

a 

a 

B 

Max 

0.93044 

0.44733 

0.41622 

n 

n 

B 

Mm 

0.98797 

0.09213 

0.09103 

6 

a 

D 

B 

Max 

0.41689 

n 

D 

B 

Min 

0.98799 

008947 

0  08839 

Due  to  this  characteristic,  \vc  can  immediately  drop  the 
use  of  joint  modules  one  and  two  from  consideration  for  use 
in  the  configuration.  This  obserx’ation  also  has  a  statistical 
basis  as  well  discussed  ne.xt.  By  removing  two  joint  modules 
from  consideration,  the  joint  module  combinations  under 
consideration  drop  from  216  to  64,  a  70%  reduction  in  the 
design  space.  It  is  immediately  apparent  that  the  RPI,  even  if 
a  true  optimum  point  cannot  be  determined,  can  drastically 
reduce  the  design  space  when  trx'ing  to  determine  the 
configuration  for  a  particular  task.  Once  the  design  space  has 
been  reduced,  the  configuration  can  be  chosen  using 
additional  criteria  such  as  payload,  weight,  inertia,  etc.  as  was 
done  in  Ambrose  and  Tesar  (1). 

The  locations  of  the  maximum  and  minimum  values 
from  Table  3  are  intuitive.  the  ma.\imum  actuator 
combinations  choose  the  mid-range  modules,  trading  off 
reliability  with  precision.  It  also  shows  that  the  RPI  is 
exlremelj'  sensitive  to  the  amount  of  error  allowed  at  the  end- 
effector. 

4.3  Significance  Studies 

Since  the  data  is  sorted  into  four  easily  identifiable 
classifications.  Analysis  of  Variance  (ANOVA)  [14]  presents 
itself  as  a  logical  means  of  studying  the  differences  between 
the  modules  and  their  effect  on  the  Reliability  Performance 
Index.  In  this  case,  the  factors  will  be  the  link  options,  and 
the  three  joint  locations;  base,  elbow  and  wrist,  each  with  six 
levels  (the  different  link  options  and  six  different  joint 
modules). 

There  are  several  different  hypothesis  tests  that  can  be 
made  using  the  ANOVA  technique.  The  first  is  to  determine 
if  the  effect  of  a  particular  factor  is  a  significant  contributor  to 
the  model.  The  next  test  that  can  be  performed  is  to 
determine  which  levels  of  the  different  factors  are 
significantly  different  from  the  others  Both  of  these  tests  are 
carried  out  on  the  data  generated  from  the  simulation  of  the 


system  of  Figure  1  following  the  trajectory  of  Figure  2  The 
data  of  Figures  3  and  4  w  ere  stored  on  diskette  and  analy  zed 
using  the  SAS  Statistical  Analysis  Software  System  [16] 

To  study  the  effects  of  the  joint  modules  and  link 
options,  the  interaction  effects  were  added  to  the  error 
resulting  in  the  ANOV^A  table  of  Table  4 


Table  4.  Analysis  of  Variance  Table  for  the  Reliability 
Performance  Index  Case  Study  (Interactions 
Added  to  Error) 


Error 

Source 

Degree  of 
Freedom 

F* 

B 

5 

20.42 

4.08 

729.5 

E 

5 

7.8 

1,56 

278.97 

W 

5 

4.2 

0.84 

150.2 

L 

5 

41.5 

8.3 

1484.01 

ERR 

1275 

7.131 

0.00559 

TOTALS 

1295 

81.111 

To  test  for  significance  of  the  main  effects  (B,  E.  W, 
and  L)  we  form  a  null  hyTxithesis  of  Main  effects  are  not 
significant,  which  results  in  the  test  value  Fj  1275.095  ~  2. 57. 
Using  the  rejection  region  of  F*  >  F,  we  find  all  of  the  main 
effects  contribute  significantly  to  the  statistical  model.  We 
can  now  test  for  the  significance  of  the  individual  levels  of 
the  main  effects  (which  was  the  test  we  desired).  This  test  is 
the  Tukey  Studentized  Range  test  (14,  16].  It  determines  that 
a  significant  difference  exists  between  the  means  of  the 
effects  levels  and  then  makes  pairwise  comparisons  to 
determine  if  there  is  a  statistical  difference  between  the  two 
levels.  The  results  of  this  test  is  presented  in  Figures  5 
through  8.  The  brackets  under  the  number  lines  in  Figures  5 
through  12  represent  statistical  differences  between  the 
adjacent  values  on  the  number  line  above  them.  If  the 
bracket  overlaps  two  values,  the  test  could  not  statistically 
differentiate  between  those  two  values.  For  instance,  in 
Figure  5,  the  mean  RPI  for  joint  modules  1  and  2  are 
statistically  different  since  the  ranges  shown  on  the  brackets 
underneath  do  not  overlap  both  module  locations  on  the  line. 
The  figure  shows  that  there  is  no  statistical  difference 
between  joint  modules  6,  5,  and  4,  but  there  is  a  statistical 
difference  between  joint  modules  6  and  3. 

From  the  e.\amination  of  Figures  5  through  7,  we  can 
see  that  there  is  a  definite  statistical  difference  in  the  mean  of 
the  RPI  when  joint  modules  1  and  2  arc  used  in  any  position. 
The  mean  value  of  the  RPI  is  lower  for  these  two  joint 
modules  and  gives  a  statistical  basis  for  the  conclusion  that 
joint  modules  1  and  2  should  be  removed  from  the  set  of 
possible  joint  modules.  Since  there  is  not  any  definitive 
statistical  difference  between  the  other  joint  modules,  other 
design  criteria  should  be  used  to  select  the  final  positions  of 
the  joint  modules. 
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Joint  Module  1  2  6  5  4  3 

RPlMenn  0.22  0.38  0  543  0.548  0  553  0.555 


Significance 

Range 


Figure  5.  Tukey  Studenlized  Range  Test  on  Levels  of  Base 
fof  the  Reliability  Performance  Inde.x 


Joint  Module  6  5  4  3 

RPlMean  0  6363  0  6428  0  6492  0  6531 


Significance 
Range 

Figure  9.  Tukey  Studentized  Range  Test  on  Levels  of  Base 
for  the  Reliability  Performance  Inde.x  (Reduced  Data  Set) 


Joint  Module  1  2  6  5  4  3 

RPlMean  0.30  0.45  0.507  0.512  0.516  0  520 

Significance  i  i 

Range  I - 1  I - 1  | _  [ 

Figure  6.  Tukey  Studenlized  Range  Test  on  Levels  of  Elbow 
for  the  Reliability  Performance  Index 


Joint  Module  1  2  6  5  4  3 

RPI  Mean  0.342  0.473  0  49  0.495  0.5  0.504 

^ - 1 - 1 - 1 - 1 - ^ - 

Significance  i _ i 

Range  I - 1  I - 1  | _  | 

Figure  7.  Tukey  Studentized  Range  Test  on  Levels  of  Wrist 
for  the  Reliability  Performance  Index 


Link  Option  6  4  5  3  1  2 

RPI  Mean  0.282  0.298  0.295  0.623  0.647  0  668 

- ^ - 1 - ^ - 1 - 1 - ^ - 

Significance  ■  t 

Range  | _ !_|  1 - 1  I - 1  I - 1 

Figure  8.  Tukey  Studentized  Range  Test  on  Levels  of  Link 
Option  for  the  Reliability  Performance  Index 

Figure  8  shows  the  result  of  the  Tukey  test  for  the  Link 
Options.  As  noted  earlier,  the  difference  in  length  tolerance 
between  the  options  is  significant,  however,  this  test  indicates 
a  statistical  difference  between  the  first  three  link  options. 
We  can  conclude  from  this  test  that  link  option  two  (which  is 
where  the  maximum  RPI  value  was  located)  has  a  statistically 
higher  mean  RPI  than  the  other  two  tight  tolerance  link 
options  and  should  be  used.  This  differentiation  does  not 
exist  between  the  wider  tolerance  suggesting  that  having 
large  differences  between  the  design  levels  enables  the  RPI  to 
better  glean  the  reduced  design  space  for  all  the  design 
options. 

After  removing  joint  modules  1  and  2  from 
consideration  for  inclusion  into  the  configuration,  the 
ANOVA  and  Tukey  tests  were  run  again.  The  removal  of  the 
two  modules  reduced  the  number  of  data  points  to  384  from 
1296.  Figures  9  through  12  show  the  results  of  the  Tukey 
Tests  on  the  reduced  data  set.  The  Tukey  Tests  show  that 
with  the  reduced  data  set,  we  can  now  sec  distinct  statistical 
differences  between  the  joint  modules  RPI  means.  On  the 
basis  of  the  RPI,  we  would  select  joint  module  3  for  use  in  all 
three  joint  locations.  The  penalty  for  the  reduction  in  the 
data  is  seen  in  Figure  12,  where  we  have  lost  delineation 
between  the  link  options  in  each  tolerance  range.  This  is 


Joint  Module  6  5  4  3 

RPlMean  0.6362  0.6428  0  6485  0.65399 


Significance 

Range  ( - 1  |— I  I - 1  i - 1 

Figure  10.  Tukey  Studenlized  Range  Test  on  Levels  of 
Elbow  for  the  Reliability  Performance  Index  (Reduced  Set) 


Joint  Module  6  5  4  3 

RPlMean  0.6358  0.6421  0.6485  0.6551 

- 1 - 1 - ^ ^ - 

Signiricancc 

Range  | - 1  I - 1  1 - 1  I - 1 

Figure  11.  Tukey  Studenlized  Range  Test  on  Levels  of  Wrist 
for  the  Reliability  Performance  Index  (Reduced  Set) 


Link  Option  6  4  5  3  I  2 

RPlMean  0.4006  0.4011  0.4016  0.88966  0.88967  0.88968 

— I - 1 - ^ - 1 - 1 - 1 - 

Significance  j  i  i  | 

Range 

Figure  12,  Tukey  Studentized  Range  Test  on  Levels  of  Link 
Option  for  the  Reliability  Performance  Index  (Reduced  Set) 

correct  statistically,  since  the  power  of  the  tests  were  reduced 
when  data  was  deleted. 

5 .  CONCL  USJONSAND  RECOMMENDA  TJONS 

This  case  study  has  shown  that  the  framew'ork  for  the 
Reliability  Performance  Index  is  a  useful  empirical  tool 
during  the  selection  and  design  of  a  configuration  of  robotic 
modules  of  varying  reliability  and  precision.  It  proves  useful 
as  a  design  guideline  to  describe  how  a  particular 
combination  or  configuration  of  modules  will  perform  with 
respect  to  the  system  reliability  moderated  by  its  precision. 
While  the  framework  for  the  RPI  was  developed,  the  data  to 
fully  investigate  its  effects  on  realistic  systems  is  not 
available. 

The  RPI  does  not  lend  itself  to  deterministic 
optimization  due  to  the  stochastic  nature  of  the  components 
of  the  RPI.  However,  it  readily  allows  for  the  rejection  of 
module  and  link  combinations  as  unsuitable,  thus  reducing 
the  design  space.  In  the  case  study,  analysis  of  the  RPI  over 
the  design  space  suggested  that  joint  modules  1  and  2  could 
be  removed  from  consideration  and  that  link  option  2 
presented  itself  as  the  best  alternative  to  provide  for 
maximum  precision  as  measured  by  the  RPI.  This  is  a  70% 
reduction  in  the  joint  module  design  space  and  an  overall 
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reduction  of  95%  (by  selecting  link  option  2)  Additional 
tests  on  a  reduced  data  set  (formed  by  remov  ing  joint  modules 
1  and  2)  showed  that  we  could  discriminate  between  the 
remaining  joint  modules  with  the  recommendation  to  use  ji) 
joint  module  3  in  all  joint  locations  However,  discrimination 
was  lost  on  the  link  options  since  we  had  much  less  data  to 
work  with 

It  was  also  seen  that  for  larger  design  spaces  and 
differences  in  the  module  characteristics,  better  *** 
discrimination  was  obtained  using  the  RPl.  The  use  of  the 
RPl  allows  the  designer  to  eliminate  a  large  portion  of  the 
design  space  and  a  final  design  can  be  selected  using  other  p] 
operational  design  criteria 

Several  recommendations  concerning  the  RPl  can  be 
made.  First,  a  more  thorough  investigation  of  the 
interactions  between  the  components  of  the  RPl  needs  to  be 
made.  The  development  of  the  RPl  assumed  that  while 
hardware  failures  will  cause  a  failure  in  the  kinematic  sense, 
the  hardware  and  kinematic  reliabilities  were  independent,  (5) 
which  lead  directly  to  the  formulation  of  Equation  (1).  This 
is  not  actually  the  case,  since  a  failure  in  the  kinematic  sense 
can  be  dependent  upon  hardware  failures.  This  dependency 
should  be  understood  to  be  able  to  improve  the  relationship 
defined  in  Equation  (1). 

The  sensitivity  of  the  RPl  to  the  actual  design  (7j 
parameters  also  requires  investigation.  A  way  of  applying  the 
RPl  to  monolithic  svstems  mav  show  the  same  results  as  to 
selecting  modular  configurations,  but  this  requires  a  direct 
mapping  to  design  parameters.  As  shown  in  [17],  a  direct 
relationship  exists  between  the  Jacobian  of  a  manipulator  and  (9] 
the  s-variances  of  the  end-effector  s-distribulion.  An  analyaic 
formulation  is  required  and  will  allow  the  development  of  the 
sensitivity  of  the  RPl  to  the  module  level  design  parameters. 

The  RPl  was  seen  to  provide  unreliable  results  when 
used  as  a  deterr.iinistic  design  optimization  criterion.  This 
may  not  be  the  case  w'hen  probabilistic  optimization  methods 
are  used  since  the  RPl  is  stochastic  in  nature.  The  RPl 
should  be  investigated  in  terms  of  probabilistic  optimizations.  |it] 
Additionally,  more  realistic  e.\amplcs  in  the  application  of  the 
RPl  should  be  developed  to  determine  if  the  results  noted  in 
this  small  case  study  can  be  generally  e.vtended. 

To  take  complete  advantage  of  a  modular  system,  the 
customer  requires  a  way  to  easily  and  quickly  determine  new 
configurations.  The  RPl  shows  promise  in  reducing  the 
design  space  for  the  selection  of  modular  configurations  but  |i3] 
needs  to  be  incorporated  into  an  on-line  computer-aided 
design  system.  This  will  allow  the  designer  to  immediately 
make  the  indicated  configuration  or  design  changes  and 
immediately  see  the  changes  in  the  design  criteria,  including 
the  RPl.  (15) 
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